WeatherProfiling Report

Dataset statistics

Number of variables	16
Number of observations	29748
Missing cells	2912
Missing cells (%)	0.6%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	10.4 MiB
Average record size in memory	366.0 B

Variable types

Numeric	10
Categorical	6

Alerts

`Location` has constant value "172.30.24.203"	Constant
`MessageTime` has a high cardinality: 29748 distinct values	High cardinality
`AmbientTemperature` is highly correlated with `AmbientTemperatureHigh` and 4 other fields	High correlation
`AmbientTemperatureHigh` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`AmbientTemperatureLow` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`HeatIndex` is highly correlated with `AmbientTemperature` and 4 other fields	High correlation
`DewPoint` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`RelativeHumidity` is highly correlated with `AmbientTemperature` and 1 other fields	High correlation
`BarometricPressure` is highly correlated with `BarometricPressureN3`	High correlation
`BarometricPressureN3` is highly correlated with `BarometricPressure`	High correlation
`AmbientTemperature` is highly correlated with `AmbientTemperatureHigh` and 3 other fields	High correlation
`AmbientTemperatureHigh` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`AmbientTemperatureLow` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`HeatIndex` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`DewPoint` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`AmbientTemperature` is highly correlated with `AmbientTemperatureHigh` and 3 other fields	High correlation
`AmbientTemperatureHigh` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`AmbientTemperatureLow` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`HeatIndex` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`DewPoint` is highly correlated with `AmbientTemperature` and 3 other fields	High correlation
`BarometricPressure` is highly correlated with `BarometricPressureN3`	High correlation
`BarometricPressureN3` is highly correlated with `BarometricPressure`	High correlation
`WindDirection` is highly correlated with `Location`	High correlation
`BarometricPressureStatus` is highly correlated with `Location`	High correlation
`Location` is highly correlated with `WindDirection` and 3 other fields	High correlation
`RainToday` is highly correlated with `Location`	High correlation
`RainLastHour` is highly correlated with `Location`	High correlation
`Id` is highly correlated with `AmbientTemperature` and 11 other fields	High correlation
`AmbientTemperature` is highly correlated with `Id` and 7 other fields	High correlation
`AmbientTemperatureHigh` is highly correlated with `Id` and 7 other fields	High correlation
`AmbientTemperatureLow` is highly correlated with `Id` and 10 other fields	High correlation
`HeatIndex` is highly correlated with `Id` and 7 other fields	High correlation
`DewPoint` is highly correlated with `Id` and 7 other fields	High correlation
`RelativeHumidity` is highly correlated with `Id` and 8 other fields	High correlation
`BarometricPressure` is highly correlated with `Id` and 7 other fields	High correlation
`BarometricPressureN3` is highly correlated with `Id` and 2 other fields	High correlation
`BarometricPressureStatus` is highly correlated with `Id` and 3 other fields	High correlation
`WindDirection` is highly correlated with `Id` and 7 other fields	High correlation
`RainToday` is highly correlated with `Id` and 4 other fields	High correlation
`RainLastHour` is highly correlated with `Id` and 1 other fields	High correlation
`WindDirection` has 2912 (9.8%) missing values	Missing
`MessageTime` is uniformly distributed	Uniform
`Id` has unique values	Unique
`MessageTime` has unique values	Unique
`BarometricPressureN3` has 836 (2.8%) zeros	Zeros
`WindSpeed` has 1488 (5.0%) zeros	Zeros

Reproduction

Analysis started	2022-05-02 12:36:27.192757
Analysis finished	2022-05-02 12:36:41.489766
Duration	14.3 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

Id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	29748
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1626583990

Minimum	1621346390
Maximum	1637096286
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	1621346390
5-th percentile	1621462314
Q1	1622311850
median	1625324057
Q3	1631384888
95-th percentile	1632667506
Maximum	1637096286
Range	15749896
Interquartile range (IQR)	9073039

Descriptive statistics

Standard deviation	4384437.989
Coefficient of variation (CV)	0.002695488224
Kurtosis	-1.269404601
Mean	1626583990
Median Absolute Deviation (MAD)	3578058
Skewness	0.3575351747
Sum	4.838762052 × 10¹³
Variance	1.922329648 × 10¹³
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1621346390	1	< 0.1%
1629478920	1	< 0.1%
1629479280	1	< 0.1%
1629479250	1	< 0.1%
1629479220	1	< 0.1%
1629479190	1	< 0.1%
1629479160	1	< 0.1%
1629479130	1	< 0.1%
1629479100	1	< 0.1%
1629479070	1	< 0.1%
Other values (29738)	29738	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1621346390	1	< 0.1%
1621346420	1	< 0.1%
1621346450	1	< 0.1%
1621346480	1	< 0.1%
1621346810	1	< 0.1%
1621346840	1	< 0.1%
1621347620	1	< 0.1%
1621347650	1	< 0.1%
1621347770	1	< 0.1%
1621347800	1	< 0.1%

Value	Count	Frequency (%)
1637096286	1	< 0.1%
1637096256	1	< 0.1%
1637096226	1	< 0.1%
1637096196	1	< 0.1%
1637096166	1	< 0.1%
1637096136	1	< 0.1%
1637096106	1	< 0.1%
1637096076	1	< 0.1%
1637096046	1	< 0.1%
1637096016	1	< 0.1%

MessageTime
Categorical

HIGH CARDINALITY
UNIFORM
UNIQUE

Distinct	29748
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	2.3 MiB

2021-05-18 13:59:50.000	1
2021-08-20 13:02:00.000	1
2021-08-20 13:08:00.000	1
2021-08-20 13:07:30.000	1
2021-08-20 13:07:00.000	1
Other values (29743)	29743

Length

Max length	23
Median length	23
Mean length	23
Min length	23

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	29748 ?
Unique (%)	100.0%

Sample

1st row	2021-05-18 13:59:50.000
2nd row	2021-05-18 14:00:20.000
3rd row	2021-05-18 14:00:50.000
4th row	2021-05-18 14:01:20.000
5th row	2021-05-18 14:06:50.000

Common Values

Value	Count	Frequency (%)
2021-05-18 13:59:50.000	1	< 0.1%
2021-08-20 13:02:00.000	1	< 0.1%
2021-08-20 13:08:00.000	1	< 0.1%
2021-08-20 13:07:30.000	1	< 0.1%
2021-08-20 13:07:00.000	1	< 0.1%
2021-08-20 13:06:30.000	1	< 0.1%
2021-08-20 13:06:00.000	1	< 0.1%
2021-08-20 13:05:30.000	1	< 0.1%
2021-08-20 13:05:00.000	1	< 0.1%
2021-08-20 13:04:30.000	1	< 0.1%
Other values (29738)	29738	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
2021-05-29	2879	4.8%
2021-05-30	2191	3.7%
2021-09-11	1389	2.3%
2021-08-21	1277	2.1%
2021-09-25	1223	2.1%
2021-08-08	1123	1.9%
2021-07-03	1099	1.8%
2021-09-26	1022	1.7%
2021-09-18	1017	1.7%
2021-09-19	983	1.7%
Other values (21521)	45293	76.1%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

AmbientTemperature
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	48
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	72.08847654

Minimum	0
Maximum	92
Zeros	39
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	49
Q1	65
median	73
Q3	82
95-th percentile	89
Maximum	92
Range	92
Interquartile range (IQR)	17

Descriptive statistics

Standard deviation	12.14163112
Coefficient of variation (CV)	0.1684267959
Kurtosis	0.6637903233
Mean	72.08847654
Median Absolute Deviation (MAD)	9
Skewness	-0.6365920525
Sum	2144488
Variance	147.4192063
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=48)

Value	Count	Frequency (%)
68	1356	4.6%
86	1346	4.5%
82	1175	3.9%
72	1148	3.9%
74	1135	3.8%
48	1104	3.7%
66	1078	3.6%
75	1051	3.5%
81	1028	3.5%
88	924	3.1%
Other values (38)	18403	61.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	39	0.1%
46	19	0.1%
47	208	0.7%
48	1104	3.7%
49	375	1.3%
50	237	0.8%
51	321	1.1%
52	247	0.8%
53	184	0.6%
54	798	2.7%

Value	Count	Frequency (%)
92	10	< 0.1%
91	185	0.6%
90	556	1.9%
89	802	2.7%
88	924	3.1%
87	920	3.1%
86	1346	4.5%
85	769	2.6%
84	920	3.1%
83	817	2.7%

AmbientTemperatureHigh
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	39
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	76.07802205

Minimum	54
Maximum	92
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	54
5-th percentile	54
Q1	69
median	77
Q3	84
95-th percentile	89
Maximum	92
Range	38
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	10.09496028
Coefficient of variation (CV)	0.1326922021
Kurtosis	-0.540652886
Mean	76.07802205
Median Absolute Deviation (MAD)	7
Skewness	-0.5855149204
Sum	2263169
Variance	101.908223
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=39)

Value	Count	Frequency (%)
76	2138	7.2%
83	2071	7.0%
63	1947	6.5%
54	1892	6.4%
77	1685	5.7%
84	1413	4.7%
82	1309	4.4%
86	1287	4.3%
89	1200	4.0%
85	1174	3.9%
Other values (29)	13632	45.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
54	1892	6.4%
55	14	< 0.1%
56	56	0.2%
57	18	0.1%
58	105	0.4%
59	54	0.2%
60	284	1.0%
61	247	0.8%
62	101	0.3%
63	1947	6.5%

Value	Count	Frequency (%)
92	144	0.5%
91	625	2.1%
90	552	1.9%
89	1200	4.0%
88	923	3.1%
87	1046	3.5%
86	1287	4.3%
85	1174	3.9%
84	1413	4.7%
83	2071	7.0%

AmbientTemperatureLow
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	45
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	63.10286406

Minimum	46
Maximum	91
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	46
5-th percentile	48
Q1	56
median	64
Q3	68
95-th percentile	83
Maximum	91
Range	45
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	9.842674827
Coefficient of variation (CV)	0.1559782583
Kurtosis	-0.1570455333
Mean	63.10286406
Median Absolute Deviation (MAD)	7
Skewness	0.2999384151
Sum	1877184
Variance	96.87824776
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=45)

Value	Count	Frequency (%)
65	2837	9.5%
48	2438	8.2%
66	1998	6.7%
54	1866	6.3%
59	1729	5.8%
67	1559	5.2%
71	1378	4.6%
61	1365	4.6%
74	1359	4.6%
57	1227	4.1%
Other values (35)	11992	40.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
46	1016	3.4%
47	61	0.2%
48	2438	8.2%
49	234	0.8%
50	189	0.6%
51	243	0.8%
52	112	0.4%
53	427	1.4%
54	1866	6.3%
55	43	0.1%

Value	Count	Frequency (%)
91	19	0.1%
90	235	0.8%
89	54	0.2%
88	84	0.3%
87	11	< 0.1%
86	38	0.1%
85	97	0.3%
84	907	3.0%
83	189	0.6%
82	94	0.3%

HeatIndex
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	57
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	73.17591099

Minimum	0
Maximum	101
Zeros	39
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	49
Q1	65
median	73
Q3	83
95-th percentile	95
Maximum	101
Range	101
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	13.59719831
Coefficient of variation (CV)	0.1858152243
Kurtosis	0.1932860358
Mean	73.17591099
Median Absolute Deviation (MAD)	10
Skewness	-0.263654386
Sum	2176837
Variance	184.883802
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
68	1356	4.6%
82	1223	4.1%
86	1158	3.9%
72	1148	3.9%
74	1135	3.8%
48	1104	3.7%
66	1078	3.6%
75	1051	3.5%
71	843	2.8%
94	809	2.7%
Other values (47)	18843	63.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	39	0.1%
46	19	0.1%
47	208	0.7%
48	1104	3.7%
49	375	1.3%
50	237	0.8%
51	321	1.1%
52	247	0.8%
53	184	0.6%
54	798	2.7%

Value	Count	Frequency (%)
101	5	< 0.1%
100	68	0.2%
99	168	0.6%
98	272	0.9%
97	214	0.7%
96	446	1.5%
95	563	1.9%
94	809	2.7%
93	539	1.8%
92	315	1.1%

DewPoint
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	42
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	57.86620949

Minimum	0
Maximum	76
Zeros	39
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	40
Q1	53
median	59
Q3	63
95-th percentile	73
Maximum	76
Range	76
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	9.91555008
Coefficient of variation (CV)	0.1713530257
Kurtosis	0.8510146186
Mean	57.86620949
Median Absolute Deviation (MAD)	5
Skewness	-0.6565093116
Sum	1721404
Variance	98.31813338
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=42)

Value	Count	Frequency (%)
61	2465	8.3%
62	2422	8.1%
58	2237	7.5%
60	1987	6.7%
57	1511	5.1%
40	1386	4.7%
59	1274	4.3%
56	1162	3.9%
73	1035	3.5%
70	1026	3.4%
Other values (32)	13243	44.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	39	0.1%
36	117	0.4%
37	291	1.0%
38	457	1.5%
39	268	0.9%
40	1386	4.7%
41	487	1.6%
42	258	0.9%
43	442	1.5%
44	804	2.7%

Value	Count	Frequency (%)
76	66	0.2%
75	147	0.5%
74	621	2.1%
73	1035	3.5%
72	768	2.6%
71	528	1.8%
70	1026	3.4%
69	766	2.6%
68	282	0.9%
67	473	1.6%

RelativeHumidity
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	64
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	62.39000941

Minimum	0
Maximum	95
Zeros	39
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	37
Q1	51
median	63
Q3	73
95-th percentile	86
Maximum	95
Range	95
Interquartile range (IQR)	22

Descriptive statistics

Standard deviation	15.04535686
Coefficient of variation (CV)	0.2411500976
Kurtosis	-0.5521710858
Mean	62.39000941
Median Absolute Deviation (MAD)	11
Skewness	-0.1458895912
Sum	1855978
Variance	226.362763
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
67	962	3.2%
62	906	3.0%
66	858	2.9%
68	832	2.8%
45	826	2.8%
63	789	2.7%
61	781	2.6%
69	722	2.4%
75	720	2.4%
70	712	2.4%
Other values (54)	21640	72.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	39	0.1%
33	33	0.1%
34	501	1.7%
35	335	1.1%
36	367	1.2%
37	415	1.4%
38	380	1.3%
39	343	1.2%
40	276	0.9%
41	346	1.2%

Value	Count	Frequency (%)
95	19	0.1%
94	148	0.5%
93	21	0.1%
92	22	0.1%
91	125	0.4%
90	201	0.7%
89	205	0.7%
88	299	1.0%
87	350	1.2%
86	300	1.0%

BarometricPressure
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	115
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	29.42184214

Minimum	28.54
Maximum	30.27
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	28.54
5-th percentile	28.6
Q1	29.27
median	29.45
Q3	29.6
95-th percentile	30.18
Maximum	30.27
Range	1.73
Interquartile range (IQR)	0.33

Descriptive statistics

Standard deviation	0.4310390118
Coefficient of variation (CV)	0.01465030673
Kurtosis	-0.1604534351
Mean	29.42184214
Median Absolute Deviation (MAD)	0.17
Skewness	-0.1804628058
Sum	875240.96
Variance	0.1857946297
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
29.45	978	3.3%
29.46	943	3.2%
29.5	851	2.9%
29.32	832	2.8%
29.49	746	2.5%
29.31	736	2.5%
29.33	730	2.5%
29.36	707	2.4%
29.51	620	2.1%
29.48	604	2.0%
Other values (105)	22001	74.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
28.54	17	0.1%
28.55	99	0.3%
28.56	112	0.4%
28.57	258	0.9%
28.58	311	1.0%
28.59	421	1.4%
28.6	289	1.0%
28.61	130	0.4%
28.62	198	0.7%
28.63	313	1.1%

Value	Count	Frequency (%)
30.27	16	0.1%
30.26	195	0.7%
30.25	274	0.9%
30.24	98	0.3%
30.23	119	0.4%
30.22	73	0.2%
30.21	107	0.4%
30.2	63	0.2%
30.19	164	0.6%
30.18	420	1.4%

BarometricPressureN3
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	99
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	28.5990117

Minimum	0
Maximum	30.26
Zeros	836
Zeros (%)	2.8%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	28.59
Q1	29.25
median	29.44
Q3	29.64
95-th percentile	30.18
Maximum	30.26
Range	30.26
Interquartile range (IQR)	0.39

Descriptive statistics

Standard deviation	4.88219462
Coefficient of variation (CV)	0.1707120047
Kurtosis	30.09937398
Mean	28.5990117
Median Absolute Deviation (MAD)	0.19
Skewness	-5.64081227
Sum	850763.4
Variance	23.8358243
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
29.31	1080	3.6%
29.66	1044	3.5%
29.46	929	3.1%
0	836	2.8%
29.36	828	2.8%
29.51	778	2.6%
29.44	773	2.6%
29.32	741	2.5%
29.35	717	2.4%
29.45	657	2.2%
Other values (89)	21365	71.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	836	2.8%
28.51	120	0.4%
28.53	120	0.4%
28.55	120	0.4%
28.57	240	0.8%
28.59	140	0.5%
28.6	120	0.4%
28.61	353	1.2%
28.62	273	0.9%
28.63	240	0.8%

Value	Count	Frequency (%)
30.26	240	0.8%
30.25	319	1.1%
30.24	120	0.4%
30.23	356	1.2%
30.21	120	0.4%
30.2	120	0.4%
30.18	255	0.9%
30.17	120	0.4%
30.16	120	0.4%
30.15	120	0.4%

BarometricPressureStatus
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.8 MiB

Steady	23978
Falling	3490
Rising	1444
RisingRapidly	836

Length

Max length	13
Median length	6
Mean length	6.314037919
Min length	6

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Steady
2nd row	Steady
3rd row	Steady
4th row	Steady
5th row	Steady

Common Values

Value	Count	Frequency (%)
Steady	23978	80.6%
Falling	3490	11.7%
Rising	1444	4.9%
RisingRapidly	836	2.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
steady	23978	80.6%
falling	3490	11.7%
rising	1444	4.9%
risingrapidly	836	2.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

WindSpeed
Real number (ℝ_≥0)

ZEROS

Distinct	17
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4.390480032

Minimum	0
Maximum	17
Zeros	1488
Zeros (%)	5.0%
Negative	0
Negative (%)	0.0%
Memory size	232.5 KiB

Quantile statistics

Minimum	0
5-th percentile	0.35
Q1	2
median	4
Q3	6
95-th percentile	9
Maximum	17
Range	17
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.580640029
Coefficient of variation (CV)	0.5877808372
Kurtosis	-0.1938948967
Mean	4.390480032
Median Absolute Deviation (MAD)	2
Skewness	0.4382052675
Sum	130608
Variance	6.65970296
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
3	4255	14.3%
4	4239	14.2%
2	4179	14.0%
5	3757	12.6%
6	3278	11.0%
7	2599	8.7%
1	2192	7.4%
8	1735	5.8%
0	1488	5.0%
9	1091	3.7%
Other values (7)	935	3.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1488	5.0%
1	2192	7.4%
2	4179	14.0%
3	4255	14.3%
4	4239	14.2%
5	3757	12.6%
6	3278	11.0%
7	2599	8.7%
8	1735	5.8%
9	1091	3.7%

Value	Count	Frequency (%)
17	2	< 0.1%
15	5	< 0.1%
14	17	0.1%
13	42	0.1%
12	97	0.3%
11	215	0.7%
10	557	1.9%
9	1091	3.7%
8	1735	5.8%
7	2599	8.7%

WindDirection
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	16
Distinct (%)	0.1%
Missing	2912
Missing (%)	9.8%
Memory size	1.6 MiB

NNW	5591
SSE	2771
WNW	2739
NW	2390
S	2251
Other values (11)	11094

Length

Max length	3
Median length	3
Mean length	2.380943509
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	SSE
2nd row	SE
3rd row	SSE
4th row	S
5th row	S

Common Values

Value	Count	Frequency (%)
NNW	5591	18.8%
SSE	2771	9.3%
WNW	2739	9.2%
NW	2390	8.0%
S	2251	7.6%
W	1858	6.2%
SSW	1430	4.8%
SW	1203	4.0%
NNE	1083	3.6%
WSW	1011	3.4%
Other values (6)	4509	15.2%
(Missing)	2912	9.8%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
nnw	5591	20.8%
sse	2771	10.3%
wnw	2739	10.2%
nw	2390	8.9%
s	2251	8.4%
w	1858	6.9%
ssw	1430	5.3%
sw	1203	4.5%
nne	1083	4.0%
wsw	1011	3.8%
Other values (6)	4509	16.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

RainToday
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.7 MiB

0.0	29210
0.01	538

Length

Max length	4
Median length	3
Mean length	3.018085249
Min length	3

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0.0
2nd row	0.0
3rd row	0.0
4th row	0.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
0.0	29210	98.2%
0.01	538	1.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0.0	29210	98.2%
0.01	538	1.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

RainLastHour
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.7 MiB

0.0	29670
0.01	78

Length

Max length	4
Median length	3
Mean length	3.002622025
Min length	3

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0.0
2nd row	0.0
3rd row	0.0
4th row	0.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
0.0	29670	99.7%
0.01	78	0.3%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0.0	29670	99.7%
0.01	78	0.3%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

Location
Categorical

CONSTANT
HIGH CORRELATION
REJECTED

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.0 MiB

172.30.24.203	29748

Length

Max length	13
Median length	13
Mean length	13
Min length	13

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	172.30.24.203
2nd row	172.30.24.203
3rd row	172.30.24.203
4th row	172.30.24.203
5th row	172.30.24.203

Common Values

Value	Count	Frequency (%)
172.30.24.203	29748	100.0%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
172.30.24.203	29748	100.0%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	Id	MessageTime	AmbientTemperature	AmbientTemperatureHigh	AmbientTemperatureLow	HeatIndex	DewPoint	RelativeHumidity	BarometricPressure	BarometricPressureN3	BarometricPressureStatus	WindSpeed	WindDirection	Location
0	1621346390	2021-05-18 13:59:50.000	66	66	61	66	59	78	29.50	29.46	Steady	3	SSE	172.30.24.203
1	1621346420	2021-05-18 14:00:20.000	66	66	61	66	59	78	29.50	29.47	Steady	3	SE	172.30.24.203
2	1621346450	2021-05-18 14:00:50.000	66	66	61	66	59	78	29.50	29.47	Steady	3	SSE	172.30.24.203
3	1621346480	2021-05-18 14:01:20.000	66	66	61	66	59	78	29.50	29.47	Steady	4	S	172.30.24.203
4	1621346810	2021-05-18 14:06:50.000	66	66	61	66	60	78	29.50	29.47	Steady	4	S	172.30.24.203
5	1621346840	2021-05-18 14:07:20.000	67	67	61	67	59	77	29.50	29.47	Steady	5	S	172.30.24.203
6	1621347620	2021-05-18 14:20:20.000	68	68	61	68	60	76	29.49	29.47	Steady	5	S	172.30.24.203
7	1621347650	2021-05-18 14:20:50.000	68	68	61	68	60	76	29.50	29.47	Steady	5	SSE	172.30.24.203
8	1621347770	2021-05-18 14:22:50.000	68	68	61	68	60	76	29.50	29.47	Steady	4	SSE	172.30.24.203
9	1621347800	2021-05-18 14:23:20.000	68	68	61	68	60	76	29.50	29.47	Steady	5	SSE	172.30.24.203

Last rows

	Id	MessageTime	AmbientTemperature	AmbientTemperatureHigh	AmbientTemperatureLow	HeatIndex	DewPoint	RelativeHumidity	BarometricPressure	BarometricPressureN3	BarometricPressureStatus	WindDirection	RainToday	Location
29738	1637096016	2021-11-16 15:53:36.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29739	1637096046	2021-11-16 15:54:06.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29740	1637096076	2021-11-16 15:54:36.000	75	75	71	75	45	34	29.32	29.35	Steady	NNW	0.01	172.30.24.203
29741	1637096106	2021-11-16 15:55:06.000	75	75	71	75	45	33	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29742	1637096136	2021-11-16 15:55:36.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29743	1637096166	2021-11-16 15:56:06.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29744	1637096196	2021-11-16 15:56:36.000	75	75	71	75	45	34	29.32	29.35	Steady	NNW	0.01	172.30.24.203
29745	1637096226	2021-11-16 15:57:06.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29746	1637096256	2021-11-16 15:57:36.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203
29747	1637096286	2021-11-16 15:58:06.000	75	75	71	75	45	34	29.31	29.35	Falling	NNW	0.01	172.30.24.203

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows